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SUMMARY 


An  Investigation  was  conducted  to  verify  the  results  of  a  report  written  by  the  Center  for 
Naval  Analyses  (CNA)  on  the  proposed  adoption  of  the  I960  Youth  Population  as  a  new  normlng 
reference  for  scores  for  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB).  This 
verification  was  conducted  primarily  to  provide  Air  Force  personnel  and  Manpower  planners  with 
Information  on  the  general  implications  of  switching  to  a  new  normative  score  scale.  The 
approach  used  was  to  replicate  the  CNA  analyses  to  confirm  results  relevant  to  the  Air  Force  and 
to  provide  a  comparison  of  the  1980  score  scale  generated  under  operational  procedures  with  the 
1944  score  scale.  The  data  base  for  the  analyses  was  test  scores  for  9,173  Males  and  females 
contained  In  the  1980  youth  sample  who  were  administered  Form  8a  of  the  ASVAB.  Comparisons  were 
made  between  the  1980  and  1944  (operational)  score  scales  for  all  subjects,  for  males  only,  and 
for  females  only.  Comparisons  were  made  for  the  Armed  Forces  Qualification  Test  (AFQT)  and  the 
four  Air  Force  selection  and  classification  composite  scores.  Results  Indicated  that  there  were 
numerous  Implications  pertaining  to  the  AFQT.  Using  the  1980  reference  population  for 
establishing  AFQT  mental  category  boundaries  will  have  substantial  Impact  on  the  number  of 
applicants  classified  as  Category  I  or  11  and  may  require  changes  to  operational  procedures  In 
the  Air  Force.  Although  the  use  of  the  1980  reference  population  and  adjusting  cut-off  scores 
will  have  a  negligible  effect  on  three  of  the  four  composites.  It  will  have  a  substantial  impact 
on  the  Mechanical  aptitude  composite.  Recomputation  of  the  CNA  analyses  Indicated  that  frequency 
distributions  and  percentages  were  essentially  correct  although  the  CNA  computations  were  not 
based  on  operational  procedures.  Other  Issues  addressed  In  the  technical,  operational,  and 
organizational  realms  resulted  In  a  recommendation  that  other  organizations  affected  by  this 
decision  (e.g..  Air  Training  Command,  Air  Force  Manpower  and  Personnel  Center)  should  be  given 
the  opportunity  to  review  and  evaluate  the  Impact  resulting  from  the  selection  of  a  new  reference 
popu  latfon. 
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This  document  verifies  a  Center  for  Naval  Analyses  report  addressing  use  of  1960  Youth 
Population  data  as  the  normative  base  for  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB).  This  verification  was  conducted  primarily  to  provide  Air  Force  personnel  and  manpower 
planners  with  Information  on  the  general  Implications  of  switching  to  a  new  normative  score 
scale.  The  results  were  provided  to  Air  Force  In  late  1962.  Between  the  completion  of  this 
paper  and  the  Implementation  of  the  1960  Score  Scale,  anomalous  performance  on  the  speeded 

subtests  of  the  ASVAB  was  detected.  The  source  of  the  anomaly  was  traced  to  the  use  of 

non-standard  answer  sheets  during  the  original  normlng  study.  This  laboratory  corrected  the 
anomaly  and  provided  corrected  conversion  tables  for  all  Air  Force  composites  and  the  Armed 
Forces  Qualification  Test  (AFQT).  The  correction  Is  reported  In  The  1980  Youth  Population: 
Correcting  the  Speeded  Subtests  (Wegner  and  Ree,  1984).  The  tables  presented  In  this  paper 
reflect  the  results  of  this  Initial  verification  study  and  they  should  not  be  considered  final 
operational  tables.  The  general  Implications  associated  with  switching  score  scales  for  Air 
Force  manpower  planners  remained  unaffected  by  the  answer  sheet  anomaly. 
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THE  1980  YOUTH  POPULATION:  A  VERIFICATION  REPORT 


I.  INTRODUCTION 

Air  Force  selection  and  classification  tests  Nave  until  now  been  tied  to  the  score  scale  of 
the  1944  World  War  II  Mobilization  population.  In  I960,  the  Department  of  Defense  administered 
the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  Form-8a  to  a  representative  sample  of 
American  youth.  The  data  from  this  administration  can  be  used  to  construct  a  new  score  scale 
referenced  to  the  aptitudes  of  the  current  population  of  enlistment-age  American  youth.  This 
paper  examines  the  consequences  of  changing  from  the  1944  score  scale  to  a  1980  scale. 

In  August  1982,  the  Center  for  Naval  Analyses  (CNA)  published  a  memorandum  (#82-31183;  Haler 
A  Sims,  1982)  which  Investigated  the  relationship  between  the  1944  and  1980  scale  scores.  To 
provide  Information  for  Air  Force  decision  making,  portions  of  the  Haler  and  Sims  work  have  been 
duplicated  In  two  ways.  First,  the  procedures  used  by  Haler  and  Sims  were  replicated  to  confirm 
their  results  which  are  relevant  to  the  Air  Force.  Second,  operational  procedures  were  also 
executed  to  allow  comparison  of  the  1980  score  scale  generated  under  operational  procedures  with 
the  1944  score  scale;  this  was  done  because  the  computations  employed  by  Haler  and  Sims  In  their 
analyses  for  the  memorandum  were  not  Identical  to  operational  procedures. 

One  way  that  the  Haler  and  Sims  effort  differs  from  usual  procedures  Is  In  what  Is  termed 
'rounding  precision.*  For  example,  the  computer  program  used  by  Haler  and  Sims  reports  numbers 
to  two  decimal  places,  so  that  a  cumulative  percent  of  3.4999  becomes  3. SO,  as  does  a  cumulative 
percent  of  3.5001.  Clearly  3.5001  exceeds  3.5  and  should  be  rounded  to  4  when  whole  numbers  are 
required.  However,  3.4999  does  not  reach  3.5  and  should  not  be  rounded  up  to  4;  yet  the  program 
used  by  Haler  and  Sims  reports  It  as  3.50,  which  would  round  to  4  under  usual  rounding  rules  when 
whole  numbers  are  used.  In  some  Instances,  this  created  a  one-score-point  discrepancy  In 
conversion  tables. 

A  second  deviation  Is  an  Inconsistency  In  rounding  rules:  In  some  cases,  values  above  .5 
were  rounded  up;  In  others,  numbers  In  the  Interval  .01  through  .99  were  rounded  down. 

A  third  difference  Is  their  a  priori  adjustment  of  the  percentile  conversion  table  for  the 
Armed  Forces  Qualification  Test  (AFQT)  to  provide  a  raw  score  conversion  to  specific  percentile 
points.  This  Is  not  necessarily  wrong,  but  unadjusted  percentiles  are  provided  In  this  paper. 

A  fourth  deviation  Is  observed  In  the  Haler  and  Sims  memorandum.  Their  subtest  standard 
scores  computed  for  the  1980  reference  population  and  the  1944  score  scale  were  allowed  to  assume 
values  outside  the  range  of  20  to  80.  Standard  scores  are  constrained  to  the  range  of  20  to  80 
operationally. 

Some  parts  of  the  Haler  and  Sims  memorandum  are  unclear  and  lack  specificity  as  to  exactly 
what  procedures  were  used.  After  numerous  conversations  with  the  authors,  their  effort  was 
duplicated  as  closely  as  their  records  and  memories  allow. 


II.  METHOD 


Subjects 

The  subjects  were  9,173  males  and  females  born  between  1957  and  1962.  The  1980  youth  sample 
contained  a  deliberate  over-representation  of  Blacks,  Hlspanlcs,  and  economically  disadvantaged 
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Whites  In  order  to  guarantee  including  their  scores  In  the  data  base.  Data  from  Individuals  In 
these  classifications  are  frequently  difficult  to  obtain,  and  without  such  data,  the  sample  could 
not  be  representative.  Weightings  were  used  for  each  subject  In  the  sample,  In  order  to 
compensate  for  differences  In  probability  of  selection  from  the  population  Into  the  sample. 
Application  of  the  weights  rendered  the  sample  representative  of  the  population  of  American  youth 
In  19S0. 


The  ASVAB 

The  Armed  Services  Vocational  Aptitude  Battery  Is  a  multiple-aptitude  test  battery  composed 
of  10  subtests,  eight  of  which  are  power  subtests  and  two  of  which  are  speeded  subtests. 

Table  A1  shows  the  ASVAB  subtests.  The  composition  of  the  AFQT  and  the  four  Air  Force 
selection  and  classification  composites  Is  shown  In  Table  B. 

Table  A.  ASVAB  Subtests 


Subtest 

No.  of  Items 

Power/Speed 

General  Science  (GS) 

25 

Power 

Arithmetic  Reasoning  (AR) 

30 

Power 

Word  Knowledge  (WK) 

35 

Power 

Paragraph  Comprehension  (PC) 

15 

Power 

Numerical  Operations  (NO) 

50 

Speed 

Coding  Speed  (CS) 

84 

Speed 

Auto/Shop  Information  (AS) 

25 

Power 

Mathematics  Knowledge  (HK) 

25 

Power 

Mechanical  Comprehension  (NC) 

25 

Power 

Electronics  Information  (El) 

20 

Power 

Verbal  (VE)* 

50 

Power 

PAmmiimlimiielnm 

raw  scores;  verbal  Is  used  In  formation  of  the  Air  Force  Administrative 
and  General  composites. 


^For  the  sake  of  clarity,  tables  In  the  body  of  this  paper  are  designated  by  a  capital  letter 
In  order  to  distinguish  them  from  numerically  designated  tables  In  the  Haler  and  Sims  memorandum. 


Table  8.  Air  Force  Coaposltes 


Composite 

Subtests* 

AFQT 

AR+WK+PC+. 5N0 

M-Hechanlcal 

2AS+MC+GS 

A-Admlnlstratlve 

NO+CS+VE 

G-General 

VE+AR 

E-Electronics 

AR+MK+EI+GS 

“Subtests  are converted to standard 
scores;  coaposltes  are  foraed  from  these 
standard  scores.  AFQT  Is  an  exception;  It 
Is  formed  from  the  raw  scores. 
Operationally.  AFQT  Is  rounded  up  to 
Integers. 


Analyses 

Using  the  1960  youth  population  data,  several  weighted  cumulative  frequency  distributions 
were  computed  to  form  the  basis  for  table  verification  and  for  development  of  tables  necessary  as 
a  basis  for  recommendations.  Weights  employed  In  generation  of  the  distributions  are  those 
contained  in  the  data  file  for  the  i960  youth  population  sample;  each  weight  Indicates  the  number 
of  persons  In  the  population  represented  by  that  particular  case.  The  weighted  cumulative 
frequency  distributions  were  not  smoothed  or  Interpolated.  Weighted  distributions  generated 
Include: 

1.  Raw  AFQT  composite  score  (not  rounded.  Raw  AFQT  score  •  WK+PC+AR  .5N0;  thus,  one  can 
obtain  half-score-point  values  In  the  distribution,  which  Is  what  Maler  i  id  Sims  did).  Under 
operational  circumstances,  half-point  scores  are  rounded  upwave,  and  this  was  done  to  the 
distribution  which  contains  half-point  score  values  In  the  present  analysis. 

2.  The  four  Air  Force  subtest  standard  rcore  composites  (MAGE),  where  the  subtest  standard 
scores  were  computed  from  means  and  standard  deviations  appropriate  to  the  World  War  II 
mobilization  population  (as  was  done  by  Maler  and  Sims).  These  computed  values  are  not 
constrained  to  the  range  of  20  to  80. 

3.  The  four  Air  Force  subtest  standard  score  composites  (MAGE),  with  subtest  standard 
scores  based  on  operational  conversion  tables.  These  tabled  values  are  constrained  to  the  range 
of  20  to  80. 

4.  The  four  Air  Force  subtest  standard  score  composites  (MAGE),  with  subtest  standard 
scores  computed  from  means  and  standard  deviations  appropriate  to  the  I960  youth  population; 
these  computed  values  are  not  constrained  to  the  range  of  20  to  80. 

5.  The  four  Air  Force  subtest  standard  score  composites  (MAGE),  with  subtest  standard 
scores  based  on  newly  constructed  conversion  tables;  these  conversion  tables  are  based  on  means 
and  standard  deviations  for  the  1980  youth  population  and  are  constrained  to  standard  score 
values  In  the  range  of  20  to  80. 

Whenever  score  scales  were  generated  under  operational  procedures,  both  the  1980  scale  and 
the  1944  (operational)  scale  subtest  standard  score  values  were  constrained  to  the  range  of  20  to 
80.  Scores  below  20  were  assigned  the  value  of  20  and  scores  above  80  were  assigned  the  value  of 
80,  as  Is  done  In  current  operational  procedures. 
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The  Haler  and  Sins  stuay  used  the  subtest  Mans  and  standard  deviations  fro*  the  weighted 
1980  youth  population  to  generate  1980  scale  scores.  They  used  subtest  Mans  and  standard 
deviations  froa  an  initial  calibration  of  A$VAB>8a  for  the  1944  scale  (instead  of  the  conversion 
tables  in  the  operational  aanual).  These  Mans  and  standard  deviations  are  given  in  Table  C.  As 
in  the  operational  case,  Haier  and  Sins  rounded  their  standard  scores  to  integer  fora. 

Only  tables  which  are  of  concern  to  the  Air  Force  have  been  investigated  in  this  paper. 
Tables  dealing  with  coaposites  or  scores  pertaining  to  the  other  services  have  not  been  verified. 


III.  RESULTS 

Comparisons  were  aade  between  the  1980  and  tha  1944  (operational)  score  scales  for  all 
subjects,  for  Bales  only,  and  for  feaales  only.  These  coaparisons  were  aade  for  the  AFQT  and  the 
four  Air  Force  coaposites.  Results  were  coaputed  using  the  Haler  and  Sins  Mthod  to  verify  the 
accuracy  of  the  results  reported  in  their  aeMrandua.  Analyses  were  also  conducted  using 
operational  procedures.  Thus,  It  is  possible  (a)  to  confira  the  accuracy  of  the  Haler  and  Sias 
analyses  given  their  procedures,  (b)  to  coapare  the  noras  for  the  1944  Mbllizetion  population 
with  noras  based  on  the  1980  youth  population  as  coaputed  by  Haler  and  Sias,  and  (c)  to  aake  this 
saae  comparison  when  noras  are  coaputed  according  to  operational  procedures  for  both  the  1944  and 
1980  reference  populations. 


Table  C.  ASVAR>8a  Heans  and  Standard  Deviations  used  by  Haler  and 
Sins  to  Coapute  Standard  Scores  for  the  1944  Reference  Population 


Subtest 

M««n* 

Standard  Deviation 

General  Science 

16.2 

5.09 

ArlthMtic  Reasoning 

17.8 

7.20 

Word  Knowledge 

25.7 

7.66 

Paragraph  Coaprehension 

10.5 

3.44 

Nuaerlcal  Operations 

36.0 

10.39 

Coding  Speed 

43.1 

16.12 

Auto/Shop  Information 

16.4 

5.60 

Mathematics  Knowledge 

12.5 

5.95 

Hechanlcal  Coaprehension 

15.5 

5.57 

Electronics  Information 

12.5 

4.32 

Verbal11 

36.2 

10.61 

‘Number  of  decimal  points 

shown  as  provided 

by  Sias  (Personal 

Commun lea t ion,  Noveaber  1982). 

bVerba1  Is  the  sua  of  Word  Knowledge  and  Paragraph 
Coaprehension. 


Verification  of  Table  1 

The  data  In  Table  1  of  the  Haler  and  Sias  Muorandua  have  been  recoaputed  and  verified  to  be 
correct  except  where  noted.  These  data  were  coaputed  for  the  total  saaple,  and  for  Bales  and 
feaales  separately.  The  AFHRL  coaputed  values  are  presented  in  Table  D.  Where  the  Haler  and 
Sias  data  deviate  froa  these  coaputations,  their  values  are  noted  in  parentheses  next  to  the  true 


Table  Da.  AFQT  Mental  Category  Raw  Score  Boundaries  In  the 
19BO  IB*  to  23-Year-Old  Youth  Population  by  Sex 


AFQT 

Category 

Raw  Score  Boundaries  Based  on: 

Hales 

Females 

Total 

V 

0-38(39} 

0-42 

0-40 

I  VC 

(40)39-47 

43-49(50) 

41-48 

IVB 

48-53 

(51)50-55 

49-54 

IVA 

54-63 

56-63 

55-63 

1 1  IB 

64-77 

64-75 

64-76 

IIIA 

78-84(85) 

76-82 

77-83 

I  IB 

(86)85-92 

83-91 

84-92 

IIA 

93-98 

92-97 

93-97 

I 

99-105 

98-105 

98-105 

*Table  D  Is  Table  1  In  the  Maler  and  Sims  wenorandue. 


Verification  of  Table  B-l 

Verification  of  the  ASVAB-Ba  AFQT  raw-to-percentlle  score  conversion  table  based  on  the  1980 
youth  population  Is  presented  In  Table  E.  This  was  Table  B-l  In  the  Haler  and  Sims  memorandum. 
This  Is  potentially  the  single  eost  Important  table  In  their  memorandum,  as  It  Is  used  by  all 
services.  Mental  categories  based  on  AFQT  scores  are  reported  annually  to  the  Congress.  A 
number  of  minor  deviations  and  typographical  errors  were  found  In  the  Haler  and  Sims  table.  The 
correct  version  of  their  Table  B-l  is  presented  In  Table  E.  The  Haler  and  Sims  values  are 
presented  In  parentheses  next  to  the  corrected  values.  Note  values  In  parentheses  next  to  the 
raw  score  column;  these  numbers  represent  typographical  errors  In  the  Haler  and  Sims  table.  The 
deviations  In  the  'Percentile  Score*  column  are  one  point  In  magnitude  and  are  of  no  significant 
Importance. 


Verification  of  Table  3 

Table  F  shows  the  percentage  of  the  weighted  1980  youth  sample  within  each  AFQT  mental 
category,  as  defined  by  the  1944  mobilization  population.  It  also  presents  World  War  II  Mental 
Category  distributions  for  comparison  purposes.  This  was  Table  3  In  the  Haler  and  Sims 
memorandum.  Their  Table  3  was  recomputed  and  a  few  deviations  were  observed.  The  corrected 
table  1$  presented  below  with  the  disparate  values  reported  by  Haler  and  Sims  shown  In 
parentheses. 


Table  Ea.  Conversion  of  ASVAB*8a  AFQT  Rev  to  Percentile 
Scores  (Based  on  the  1980  Youth  Population) 


N 


5 

>" 

I 


Table  Fa.  Percentage  of  Weighted  1980  Youth  Sample  In 
Each  1944  Scale  AFQT  Category  (By  Sex) 


1980  Sample 

AFQT 

Category 

Percentile 

Score  Range 

Males 

Females 

Total 

WWII 

Population 

I 

93-99  (100) 

5 

4 

4 

8 

11 

65-92 

35  (34) 

31 

33 

28 

III 

31-64 

29  (30) 

34 

32 

34 

IV 

10-30 

23 

25  (24) 

24 

21 

V 

1-9 

8 

6  (7) 

7 

9 

I+II 

65-99  (100) 

40  (39) 

35 

37 

36 

I+II+IIIA 

50-99  (100) 

54 

51 

53  (52) 

51 

__IV*V 

1-30 

31 

31 

31 

30 

aTab1e  F 

Is  Table  3  In  the 

Maler  and 

Sims  memorandum. 

Verification  of  Table  4 

Table  4  In  the  Haler  and  Sins  memorandum  reports  ASVAB-8a  subtest  means  and  standard 
deviations  for  the  World  War  II  population  and  for  the  weighted  1980  youth  sample.  Table  4  used 
data  from  a  previous  study  for  the  columns  marked  "WWII.*  These  raw  data  were  not  available  and 
the  values  could  not  be  recomputed.  The  columns  marked  *1980*  have  been  recomputed  and  have  been 
found  to  be  accurate.  This  and  other  tables  In  which  no  discrepancies  were  noted  are  contained 
In  Table  A-l  In  Appendix  A. 


Verification  of  Table  7 

The  Maler  and  Sims  Table  7  (presented  as  Table  G  here)  has  been  recomputed  by  the  method  they 
used.  The  table  also  has  been  recomputed  using  operational  procedures,  and  only  minor  deviations 
have  been  noted.  The  values  recomputed  by  operational  procedures  are  displayed  In  Table  G;  the 
discrepant  Maler  and  Sims  values  are  displayed  In  parentheses. 


Verification  of  Table  9 


Table  9  In  the  Maler  and  Sims  memorandum  Identifies,  for  weighted  1980  youth  sample-based 
conversions,  the  AFQT  and  sum  of  MAGE  values  which  equate  to  current  Air  Force  enlistment 
standards  as  defined  by  the  World  War  II  (WWII)  score  scale.  The  Maler  and  Sims  results  have 
been  verified  as  correct.  The  table  Is  contained  In  Appendix  A  as  Table  A-2.  It  suffices  here 
to  observe  that  an  AFQT  percentile  31  on  the  1944  scale  equals  a  percentile  32  on  the  1980  scale, 
and  percentile  65  on  the  1944  scale  equals  percentile  65  on  the  1980  scale.  A  MAGE  sum  of  120  on 
the  1944  scale  equals  a  MAGE  sum  of  130  on  the  1980  scale. 


- 
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Table  Ga.  Percent  of  I960  Youth  Staple  Below  Particular  WWII 
Score  Scale  Points  on  US  Air  Force  Composite* 


Score  on 
WWII  Scale 


_ Cumulative  Percent  of  1980  Youth  Sample _ 

Mechanical  Administrative  General  Electronics 
AI  A1  AI  AI 


•Table  G  Is  Table  7  In  the  Haler  and  Sims  memorandum. 


Verification  of  Table  10 

Table  10  In  the  Haler  and  Sins  memorandum  compares  two  alternate  ways  of  defining  AFQT 
percentiles  and  mental  categories  through  use  of  the  1980  youth  population  data.  All  data  In 
this  table  have  been  recomputed  and  verified  as  correct,  except  that  100  Is  listed  as  the  maximum 
percentile  value  when  It  should  be  99. 

The  first  way  of  defining  percentiles,  labeled  ‘Constant  Percentile  Score*  In  Table  10,  bases 
the  percentile  conversions  directly  on  the  weighted  1980  youth  sample's  distribution  without 
reference  to  the  older  standard.  It  assigns  to  mental  categories  the  same  percentile  cut-offs 
that  have  always  been  used  (e.g.,  percentile  rank  93  and  above  constitutes  mental  category  I). 
This  alternative  Is  a  clear  break  from  the  Morld  War  II  base. 

The  second  way  of  defining  percentiles  and  mental  categories,  labeled  ‘Constant  Expected 
Performance*  In  the  Haler  and  Sims  Table  10,  bases  the  percentiles  directly  on  performance  In  the 
weighted  1980  youth  sample,  but  adjusts  mental  category  boundaries  to  maintain  categories  linked 
to  the  World  War  II  population  (e.g.,  the  mental  category  I  boundary  would  become  97  and  above, 
rather  than  93  and  above;  this  would  place  4  percent  of  1980  youth  In  category  I  under  both  the 
1980  and  the  1944  percentile  categorization). 

The  difference  In  enlistment  qualification  rates  among  these  alternatives  and  the  1944  scale 
are  summarized  In  Table  H.  Note  that  the  WWII  Scale  and  the  1960  Constant  Performance  columns 
yield  Identical  cumulative  distributions;  this  Is  because  the  1980  constant  performance  mental 
category  percentile  boundaries  are  changed  to  achieve  this  end. 

It  can  be  seen  from  this  table  that  the  only  point  at  which  choice  among  the  three  conditions 
makes  any  appreciable  difference  Is  at  the  boundary  between  category  I  and  category  II. 


Verification  of  Table  B-2 

Table  B-2  In  the  Maler  and  Sims  memorandum  provides  the  proper  raw  score  to  standard  score 
conversion  table  for  ASVAB-8a  subtests  If  conversions  are  to  be  based  on  the  weighted  1960  youth 
sample.  Their  Table  B-2  has  been  verified  and  Is  correct.  It  should  be  noted  that  this  table 
was  not  used  to  compute  any  other  values  In  the  memorandum.  However,  this  table  Is  a  very 
crucial  one  since  It  Is  the  proper  table  for  conversion  of  subtest  raw  scores  to  standard  scores 
If  the  1980  youth  population  Is  adopted  as  the  normative  reference  for  the  enlistment  test 
battery.  This  table  Is  contained  In  Appendix  A  as  Table  A-3. 


Table  H*.  18-  to  23-Year-Old  1980  Youth  Enlistment  Qualification 

Rate  at  Various  Hental  Category  Cut-Offs 


AFQT 

Mental 

Category 

Cumulative  Percent 

of  Weighted  1980  Youth  Sample 

HUII 

Scale 

1980 

Constant 

Percentile 

I960 

Constant 

Performance 

I 

4 

9 

4 

IIA 

19 

19 

19 

MB 

37 

37 

37 

1 1 1 A 

52 

51 

52 

1 1  IB 

69 

70 

69 

IVA 

79 

80 

79 

IVB 

85 

85 

85 

IVC 

93 

91 

93 

V 

100 

100 

100 

*Table  H  Is  Table  10 

In  the  Maler  and  Sims 

memorandum. 

Verification  of  Table  B-5 

The  Maler  and  Sims  Table  B-5  provides  the  basic  for  conversion  of  Air  Force  aptitude 
composites  (computed  from  subtest  standard  scores)  to  their  Air  Force  percentile  equivalents 
based  on  the  weighted  1980  youth  sample.  Table  B-5  contains  correct  values,  but  for  several 
one-point  deviations  when  computed  by  the  Haler  and  Sims  method.  There  are  also  two 
typographical  errors.  These  occur  In  the  columns  for  the  General  and  Electronics  Aptitude 
Indexes  (Als).  First,  for  the  General  AI,  the  Air  Force  percentile  score  85  Is  listed  twice;  the 
second  entry  should  be  90.  For  the  Electronics  AI,  In  the  column  *SSS*  the  values  •211-206’ 
should  be  *211-216. •  Recomputation  of  this  table  by  operational  procedures  resulted  In  no  other 
changes  In  the  values  and  the  table  Is  contained  in  Appendix  A  as  Table  A-4. 

Tables  I,  J,  K,  and  I.  display  the  Impact  on  Air  Force  Aptitude  Indexes  of  changing  from  the 
1944  mobilization  population  to  the  1980  youth  population  as  the  normative  reference  for  ASVAB. 
For  each  of  the  four  Als,  these  tables  (based  on  equlpercentl le  equatlngs)  provide  cumulative 
distributions  of  the  weighted  1980  youth  sample  under  the  (present)  1944  scale  and  under  the 
(proposed)  1980  scale. 

Note  that  changing  to  the  1980  youth  population  as  a  reference  makes  very  little  difference 
In  disqualification  rates  at  frequently  used  AI  cut-offs  on  the  Administrative,  General,  and 
Electronics  Als.  However,  there  Is  a  significantly  large  difference  In  disqualification  rates 
between  the  two  scales  for  the  Mechanical  AI.  A  percentile  40  on  the  present  Mechanical  AI  would 
be  approximately  equal  to  a  percentile  55  on  the  1980  scale,  and  a  50  on  the  present  scale  would 
be  approximately  70  on  the  1980  scale.  Mechanical  AI  percentiles  40  and  50  on  the  present  scale 
are  the  cut-offs  for  virtually  all  mechanical  specialties. 


I960 


% 


Table  I.  Distribution  of  tko  Hot 

Youth  Staple  on  the  Mechanical  AI 
Under  Too  Conversion  Scales 


Table  J.  Distribution  of  the  Weighted  I960 
Youth  Staple  on  the  Adalnlstratlve  AI 
Under  Two  Conversion  Scales 


Table  K,  Distribution  of  the  Weighted  1980 
Youth  Staple  on  the  General  AI  Under 
Two  Conversion  Scales 


General  AI 
01 
OS 
JO 
15 
20 
25 
30 
35 
40 
45 
50 
55 
60 
65 
70 
75 
80 
85 
90 
95 


1980  Youth  Cumulative  Percentage 


1944  Scale 
3 
6 
12 
18 
23 
29 
34 
37 
42 
46 
51 
57 
61 
67 
71 
76 
84 
89 
96 
99 


1980  Scale 
4 
9 
14 
19 
24 
29 
34 
39 
44 
49 
54 
59 
64 
69 
74 
79 
84 
89 
94 
99 


Table  L.  Distribution  of  the  Weighted  1960 
Youth  Staple  on  the  Electronics  AI  Under 
Two  Conversion  Scales 


Electronics  AI 
01 
05 
10 
15 
20 
25 
30 
35 
40 
45 
50 
55 
60 
65 
70 
75 
80 
85 
90 
95 


1980  Youth  Cumulative  Percentage 
1944  Scale  1980  Scale 


2 

7 

13 

21 

27 

33 

39 

42 

45 

51 

56 

62 

66 

71 

76 

79 

86 

93 

98 

99 


4 

9 

14 

19 

24 

29 

34 

39 

44 

49 

54 

59 

64 

69 

74 

79 

84 

89 

94 

99 
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A  large  proportion  of  the  Kachan leal  AI  distributional  dlffarance  between  the  two  scales  Is 
attributable  to  the  Inclusion  of  females  In  the  I960  youth  sample.  Because  Bales  generally 
achieve  lower  scores  on  Mchanlca?  Measures  than  feaates,  their  Inclusion  In  the  reference 
population  altered  the  Mechanical  A!  Metric.  No  decrement  In  scores  was  found  when  the 
distribution  of  the  Mechanical  AI  was  coaputed  for  Males  alone. 


Verification  of  Table  E-3 

Table  M  (Haler  and  SIms  Table  E-3)  shows  the  cuMulatlve  percentage  of  the  1980  sawple  that 
scored  below  a  selected  set  of  decile  cut-off  percentiles  based  on  both  the  1980  scale  and  the 
1944  scale.  Using  the  Haler  and  Sins  Method,  but  with  greater  rounding  accuracy,  11  one-point 
changes  were  found.  Corrected  values  are  reported  In  the  table  and  deviant  Naler  and  SIms  values 
are  presented  In  parentheses. 


IV.  IMPLICATIONS 

The  Inpllcatlons  of  shifting  fron  the  1944  population  base  to  the  1980  population  base  for 
service  test  calibration  are  numerous.  There  are  a  series  of  Inpllcatlons  pertaining  to  the 
AFQT,  relatively  few  for  the  Air  Force  A,  8,  and  E  conposltes,  but  Many  for  the  M  composite.  The 
Issues  focus  on  the  technical,  operational,  and  organizational  concerns  which  result  from 
adopting  the  new  population  base. 


AFQT 

The  two  opticas  concerning  the  AFQT  are  either  to  retain  the  1944  population  or  to  adopt  the 
1980  population  as  a  calibration  reference  standard  (constant  percentiles). 

1.  Option  1.  Retaining  the  1944  population  base  means  that  no  changes  would  be  made  and 
the  status  quo  would  be  Maintained.  This  Implies  no  change  In  regulations,  recruiting,  training, 
and  retraining  activities  since  the  scores  would  retain  their  sane  Meaning.  But  It  further  means 
that  since  the  1944  population  contained  no  females,  they  will  continue  to  be  unrepresented  In 
determining  the  meaning  of  a  percentile  score.  Finally,  this  option  Is  In  opposition  to  the 
recommendation  of  the  Defense  Advisory  Committee  on  Military  Personnel  Testing. 

2.  Option  2.  Changing  to  the  1980  population  as  the  calibration  standard  requires 
consideration  of  the  effects  on  the  AFQT  mental  category  boundaries.  Mental  categories  are 
defined  In  terms  of  percentile  cut-offs  on  the  distributions  of  abilities  In  a  population 
(Category  I  ■  top  8%;  Category  II  -  next  28X,  etc.).  Traditionally,  the  mental  category  cut-offs 
have  been  referenced  to  the  abilities  In  the  Mill  population.  In  those  terns,  only  4X  of  the 
1980  youth  population  achieved  scores  which  are  designated  Category  I.  Should  the  mental 
categories  as  defined  above  now  be  referenced  to  the  distribution  of  abilities  In  the  1980 
population,  this  would,  by  definition,  result  In  8X  of  the  1960  population  achieving  scores 
designated  as  Category  I-thereby  creating  an  illusion  of  increased  quality  to  those  unaware  of 
the  change  In  reference  base  for  the  mental  category  definition.  Due  to  a  perceived  doubling  in 
Category  I  personnel,  the  Increase  must  be  carefully  explained  to  those  monitoring  the  number  of 
military  accessions  by  AFQT  category,  to  avoid  misinterpretation.  There  would  also  be  a 
compensating  decrease  In  the  number  of  Category  II  youth  with  the  total  numbers  of  youths  In 
Categories  I  and  II  remaining  unchanged.  The  number  of  youths  In  all  other  categories  would 
remain  about  the  sane. 


Table  M  .  Percent  of  1980  Population  Below  Selected  Aptitude  Composite 
^Prerequisite  Scores  on  1980  Scale  Air  Force  Coaposltes 


aTable  M  is  Table  E-3  In  the  Maler  and  Slas  aeaorandua 


If  the  1980  population  Is  adopted  as  the  AFQT  calibration  reference,  other  Indications  are 
evident.  First,  all  Air  Force  sys teas  tied  to  AFQT  percentile  scores  (such  as  the  Person-Job 
Natch  (PJN))  would  require  changes.  Historical  continuity  on  service  accessions'  AFQT 
performance  Mould  be  lost  (but  could  be  retained  If  conversion  tables  are  supplied  for  analytic 
purposes).  Adoption  of  the  1980  youth  population  as  the  test  calibration  reference  would  return 
the  Mental  categories  to  their  original  (1944)  distribution  In  terms  of  the  current  youth 
population.  There  Mould  be  an  Immediate  doubling  of  the  available  number  of  Category  1  youths 
for  enlistment.  This  doubling  might  appear  suspect  to  the  Congress  and  certainly  has 
Implications  for  the  Recruiting  Service.  The  Air  Force  could  be  In  a  poor  position  relative  to 
the  other  services  In  competition  for  recruiting  resources  If  too  many  of  Air  Force  recruits  are 
classified  as  Category  I. 

Additionally,  the  Air  Force  has  historically  been  accused  of  "skimming"  the  high-quality 
recruits  from  the  enlistment-eligible  pool  at  the  expense  of  the  other  services.  Should  the 
apparent  number  of  Category  I  recruits  double,  the  Air  Force  could  become  vulnerable  to  a 
resurgence  of  this  kind  of  criticism  and  face  unknoen  consequences  In  budgetary  competition  for 
recruiting  resources. 


Selector  Composites 

There  are  three  options  concerning  adoption  of  the  1980  youth  population  as  the  calibration 
reference  for  the  Air  Force  Selector  Composites: 

1.  Retain  the  1944  population,  Mlth  no  change  in  operational  procedures. 

2.  Adopt  the  1980  population  and  adjust  N,  A,  6,  and  E  qualification  cut-off  scores  to 

retain  expected  performance  relative  to  the  1944  scores. 

3.  Adopt  the  1980  population,  mlthout  adjusting  N,  A,  G,  and  E  qualification  percentile 

cut-offs. 

1.  Option  1.  Retaining  the  1944  population  base  means  no  changes  Mill  be  made.  This 

Implies  no  changes  In  regulations,  recruiting,  training,  and  retraining,  as  the  scores  retain 
their  meaning.  It  further  means  that  females  Mill  continue  to  be  unrepresented  in  determining 
the  meaning  of  percentile  scores  on  aptitude  Indexes.  Based  on  conversations  Mlth 

representatives  of  other  services.  It  Is  expected  that  none  of  the  other  services  Mill  select  the 
option  to  retain  the  1944  population  for  their  aptitude  Indexes.  If  only  the  Air  Force  falls  to 
adopt  the  1980  population,  this  policy  may  be  subject  to  review  and  criticism.  However, 
retaining  the  1944  population  as  a  calibration  reference  for  the  AIs  Is  not  likely  to  lead  to  a 
disadvantage  relative  to  the  other  services  In  acquiring  high-quality  recruits  for  technical 
training. 

2.  Option  2.  Adopting  the  1980  population  as  a  reference  and  adjusting  qualification 
cut-offs  to  maintain  present  expected  technical  school  training  performance  has  numerous 
Implications,  due  primarily  to  differences  betMeen  the  1944  and  1980  scales  In  the  distribution 
of  scores  on  the  Nechanlcal  AI.  Differences  In  score  distributions  for  the  A,  G,  and  E 
composites  based  on  the  1944  population  and  the  1980  population  are  minor,  and  use  of  present 
technical  training  school  cut-offs  Mould  have  negligible  effect  on  the  number  of  qualified 
Individuals.  Consequently,  changes  In  qualification  cut-offs  on  these  AIs  mould  not  be 
necessary.  However,  qualification  cut-offs  for  the  Nechanlcal  AI  Mill  have  to  be  raised  by  as 
much  as  15  points  to  remain  equivalent  to  present  standards.  The  new  Mechanical  AI  standards  for 
recruiting  Mill  appear  to  be  higher  than  they  presently  are  when.  In  fact,  they  have  been  changed 
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only  to  remain  equivalent.  AFR  39*1,  which  states  qualification  standards,  will  have  to  be 
revised  and  reissued.  The  Person-Job  Natch  system  will  also  have  to  be  revised  to  accommodate 
the  changed  score  requirements.  Other  systems  requiring  use  of  the  Mechanical  AI  scores  may  have 
to  be  revised  or  reaccompl Ished  as  well.  Systems  of  records  will  require  revision,  and  when 
retraining  or  reenl Istment  Is  considered.  It  could  become  necessary  to  retest  personnel  with 
ASVAB  reenllstment  scores  given  prior  to  October  1,  1980.  Longitudinal  Investigations  may  be 
less  accurate  because  of  the  necessity  of  estimating  Mechanical  AI  scores  on  the  1980  scale  for 
scores  derived  prior  to  October  1,  1980.  Additionally,  this  would  be  the  second  major  change  to 
the  score  scale  In  3  years.  However,  since  It  would  be  accomplished  In  conjunction  with  the 
Implementation  of  a  new  test.  It  may  be  more  readily  accepted  In  the  Air  Force  personnel  and 
training  community.  Adopting  Option  2  would  also  have  the  following  Implications.  The  1980 
population  was  carefully  selected  and  Is  more  representative  of  the  population  of  American  youth 
than  was  the  1944  population.  For  the  first  time,  females  were  Included  In  the  reference 
population.  Recruiting  problems  should  not  Increase,  since  Inherent  aptitude  qualifications 
would  remain  unchanged.  In  fact,  management  decisions  for  recruiting  could  be  enhanced  by 
knowledge  of  the  relative  standing  of  recruits  In  the  current  enlistment  age  population.  No 
training  problems  attributable  to  the  change  In  test  calibration  reference  population  are 
expected.  Choosing  Option  2  (l.e.,  adjusting  cut-offs  to  maintain  present  performance)  does  not 
leave  the  Air  Force  at  a  disadvantage  relative  to  the  other  services  In  recruiting  high-quality 
enlistees,  regardless  of  the  option  chosen  by  the  other  services. 

Option  3.  Accepting  Option  3  means  adopting  the  1980  population  but  not  adjusting 
qualification  scores  to  keep  expected  performance  constant.  This  particular  option  has  serious 
Implications  for  the  classification  of  recruits  on  the  M  composite.  No  changes  would  be 
necessary  to  AFR  39-1,  but  the  meaning  of  the  Mechanical  AI  percentile  scores  will  have  changed 
drastically.  Recruiting  Service  will  be  able  to  qualify  more  applicants  (especially  females)  In 
Mechanical  areas,  but  the  recruits  will  be  of  lower  true  aptitude.  As  these  recruits  move  Into 
technical  training,  It  would  be  expected  that  the  failures  and  “wash-back*  rate  would  Increase 
relative  to  those  currently  experienced.  This  could  lead  to  Increased  demands  for  additional 
technical  training  resources  or  strain  existing  training  resources.  A  shortage  of  well-trained 
Individuals  In  the  mechanical  field  could  result.  As  In  Option  2,  the  systems  of  score  records 
would  require  revision  to  reflect  new  mechanical  scores.  Changes  In  PJM  would  not  be  required, 
but  less-qualified  Individuals  would  be  assigned  to  mechanical  specialties  (as  discussed  above). 


V.  CONCLUSIONS  AND  RECOMMENDATIONS 

1.  Recomputation  of  the  CNA  analyses  as  they  apply  to  Air  Force  scores  and  standards 
indicates  that  the  frequency  distributions  and  percentages  are  essentially  correct,  although 
their  computations  were  not  based  on  operational  procedures.  Analyses  were  verified  by  AFHRL 
using  current  operational  procedures. 

2.  The  issues  from  a  psychometric,  policy,  and  organizational  standpoint  Involved  In  the 
selection  of  the  appropriate  reference  population  were  examined,  but  they  should  be  carefully 
reviewed  prior  to  finalizing  the  Air  Force  position.  It  Is  recommended  that  other  organizations 
affected  by  this  decision  be  queried  for  their  Input  (e.g..  Air  Training  Command,  Air  Force 
Manpower  and  Personnel  Center,  etc.).  The  Impact  associated  with  the  use  of  constant  percentiles 
or  constant  raw  score  boundaries  with  the  AFQT  has  also  been  addressed. 

3.  Using  the  1980  reference  population  for  establishing  AFQT  mental  category  boundaries  will 
have  substantial  Impact  on  the  numbers  of  applicants  classified  as  Category  I  or  Category  II  and 
will  require  changes  to  operational  procedures  In  the  Air  Force. 
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4.  Using  the  1980  reference  population  and  adjusting  the  cut-off  scores  Mill  have  a 
negligible  effect  on  the  A,  G,  and  E  composites,  but  Mill  have  a  substantial  Impact  on  the 
Mechanical  composite,  Mhlch  Mill  require  extensive  changes  to  operational  procedures  In  the  Air 
Force. 
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APPENDIX  A:  TABLES  REFERENCED  BUT  NOT  REPRODUCED  IN  THE  BODY  OF  THE  TEXT 


Table  A- la .  Subtest  Raw  Scores  for  WWII  and  1960  Reference  Populations 


ASVAB  Subtest 

Hean 

Standard 

Deviation 

WWII 

I960 

WWII 

1980 

General  Science 

16.2 

16.0 

5.09 

5.01 

Arithmetic  Reasoning 

17.8 

16.0 

7.20 

7.37 

Word  Knowledge 

25.7 

26.3 

7.66 

7.71 

Paragraph  Comprehension 

10.5 

11.0 

3.44 

3.36 

Numerical  Operations 

36.0 

34.5 

10.39 

10.99 

Coding  Speed 

43.1 

46.3 

16.12 

16.25 

Auto/Shop  Information 

16.4 

14.3 

5.60 

5.55 

Mathmatlcs  Knowledge 

12.5 

13.6 

5.95 

6.39 

Hechanlcal  Comprehension 

15.5 

14.2 

5.57 

5.35 

Electronics  Information 

12.5 

11.6 

4.32 

4.24 

Verbal1* 

36.2 

37.3 

10.61 

10.60 

aTabIe  A-l  Is  Table  4  In  the  Haler  and  Sins  nenorandun. 

^Verbal  Is  combination  of  Word  Knowledge  and  Paragraph  Comprehension 


subtests  (l.e.,  36.2  (WWII)  •  25.7  +  10.5). 


Table  A-2a.  Equivalent  Enlistment  Standards  on  WHII  and  1960  Scales 


'  "  -  T  T  *-  ‘  *  " 

Enlistment 

Standards 

High  School 

Graduate 

Not-HIgh  School 

Graduate 

Service 

Variable 

WW  II 

Scale 

1980 

Scale 

WWII 

Scale 

1980 

Scale 

Army 

AFQT 

16 

16 

31 

32 

Aptitude  Composite 

85 

89b 

85 

89 

Navy 

AFQT 

17 

17 

38 

38 

Air  Force 

AFQT 

31 

32 

65 

65 

MAGE  Compos1tec 

120 

130 

120 

130 

Marine  Corps 

AFQT 

General  Technical 

21 

22 

31 

32 

Composite 

80 

81 

95 

96 

aTable  A-2  Is  Table  9  In  the  Haler  and  Sins  memorandum. 
bAverage  equivalent  score  on  Army  composite. 

cSun  of  four  composites  (Hechanlcal,  Administrative,  General,  Electronics). 
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Table  A-3*  (continued) 


Tabic  A-3*  (continued) 


RAW 

6S 

AR 

(R  PC 

NO 

CS 

RAW 

a 

70 

65 

70 

m 

71 

65 

7) 

\ 

►  „ 

72 

66 

72 

»v 

73 

66 

73 

*v 

-V 

74 

67 

74 

y-‘ 

1 

75 

68 

75 

,  ^ 

■ 

76 

68 

76 

77 

69 

77 

■■ 

78 

70 

78 

79 

70 

79 

E 

80 

71 

80 

- 

• 

81 

71 

81 

k.  _ 

82 

72 

82 

{ 

83 

73 

83 

84 

73 

84 

Table  A-3*  (continued) 


RAW 

AS 

NR 

NO 

El 

VE 

RAW 

0 

24 

29 

24 

23 

20 

0 

1 

26 

30 

25 

25 

20 

1 

2 

28 

32 

27 

27 

20 

2 

3 

30 

33 

29 

30 

20 

3 

4 

31 

35 

31 

32 

20 

4 

S 

33 

37 

33 

34 

20 

5 

6 

35 

38 

35 

37 

20 

6 

7 

37 

40 

37 

39 

21 

7 

8 

39 

41 

38 

42 

22 

8 

9 

40 

43 

40 

44 

23 

9 

10 

42 

44 

42 

46 

24 

10 

11 

44 

46 

44 

49 

25 

11 

12 

46 

48 

46 

SI 

26 

12 

13 

48 

49 

48 

S3 

27 

13 

14 

49 

51 

SO 

S6 

28 

14 

IS 

51 

52 

52 

58 

29 

15 

16 

53 

54 

S3 

60 

30 

16 

17 

55 

55 

SS 

63 

31 

17 

18 

57 

57 

57 

6S 

32 

18 

19 

58 

58 

59 

68 

33 

19 

20 

60 

60 

61 

70 

34 

20 

21 

62 

62 

63 

35 

21 

22 

64 

63 

65 

36 

22 

23 

66 

65 

67 

37 

23 

24 

67 

66 

68 

37 

24 

25 

69 

68 

70 

38 

25 

26 

39 

26 

27 

40 

27 

28 

41 

28 

29 

44 

29 

30 

43 

30 

31 

44 

31 

32 

45 

32 

33 

46 

33 

34 

47 

34 

•Table 

A*3  Is  Table 

B-2  In 

the  Naler  and 

SlH  RenoranduR. 
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Table  A-**.  U.S.  Air  Force  Conversion  Tables  ASVAB  8/9/10 
Aptitude  Cosmos  It#  Scores 


Mechanical 
Aptitude  Index 

Administrative 
Aptitude  Index 

General 

Aptitude  Index 

Electronic 
Aptitude  Index 

SSS 

AI 

SSS 

AI 

SSS 

AI 

SSS 

AI 

90*140 

1 

56-  97 

1 

41-65 

1 

96-142 

I 

141-151 

5 

98-111 

5 

66-71 

5 

143-151 

5 

152*159 

10 

1 12- 12 I 

10 

72-77 

10 

152-158 

10 

160-165 

15 

122-129 

15 

78-81 

15 

159-165 

15 

166-171 

20 

130-134 

20 

62-66 

20 

166-171 

20 

172-177 

25 

135-139 

25 

67-90(69) 

25 

172-177 

25 

178-183 

30 

140-143 

30 

(90)91-93 

30 

176-163 

30 

184-187 

35 

144-147 

35 

94-96 

35 

184-186 

35 

188-193 

40 

148-150 

40 

97-99 

40 

189-193 

40 

194-198 

45 

151-153 

45 

100-102 

45 

194-199 

45 

199-203 

SO 

154-156 

50 

103-105(104) 

50 

200-204 

50 

204-209 

55 

157-159 

55 

(105)106-107 

55 

205-210 

55 

210-214 

60 

160-162 

60 

106-109 

60 

211-216(206) 

60 

215-220 

65 

163-165 

65 

110-112 

65 

217-222 

65 

221-228(227) 

70 

166-168 

70 

113-114 

70 

223-228(227) 

70 

(228)229-234(233) 

75 

169-171 

75 

115-117 

75 

(228)229-234 

75 

(232)233-240 

60 

172-175 

80 

118-119 

80 

235-240 

80 

241-248 

85 

176-179 

85 

120-122 

85 

241-247 

85 

249-258 

90 

180-184 

90 

123-124 

90(85) 

248-255 

KH 

259-276 

95 

185-199 

95 

125-126 

95 

256-272 

95 

END 

FILMED 

6-85 
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